Testing effect
──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
top
The testing effect (also known as retrieval practice, active recall, practice testing, or test-enhanced learning)cite-ref-1[1]cite-ref-15-2-0[2]cite-ref-3[3] suggests long-term memory is increased when part of the learning period is devoted to retrieving information from memory.cite-ref-4[4] It is different from the more general practice effect, defined in the APA Dictionary of Psychology as "any change or improvement that results from practice or repetition of task items or activities."cite-ref-5[5]
Cognitive psychologists are working with educators to look at how to take advantage of tests—not as an assessment tool, but as a teaching tool cite-ref-6[6] since testing prior knowledge is more beneficial for learning when compared to only reading or passively studying material (even more so when the test is more challenging for memory).cite-ref-7[7]
Contents
• History
• Quizzes
──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
History
Before much experimental evidence had been collected, the utility of testing was already evident to some perceptive observers including Francis Bacon who discussed it as a learning strategy as early as 1620.cite-ref-8[8]
"Hence if you read a piece of text through twenty times, you will not learn it by heart so easily as if you read it ten times while attempting to recite it from time to time and consulting the text when your memory fails."
Towards the end of the 17th Century, John Locke made a similar observation regarding the importance of repeated retrieval for retention in his 1689 book "An Essay Concerning Human Understanding".
"But concerning the ideas themselves, it is easy to remark, that those that are oftenest refreshed (amongst which are those that are conveyed into the mind by more ways than one) by a frequent return of the objects or actions that produce them, fix themselves best in the memory, and remain clearest and longest there."cite-ref-9[9]
Towards the end of the 19th century, Harvard psychologist William James described the testing effect in the following section of his 1890 book "The Principles of Psychology"
"A curious peculiarity of our memory is that things are impressed better by active than by passive repetition. I mean that in learning (by heart, for example), when we almost know the piece, it pays better to wait and recollect by an effort from within, than to look at the book again. If we recover the words in the former way, we shall probably know them the next time; if in the latter way, we shall very likely need the book once more." cite-ref-10[10]
The first documented empirical studies on the testing effect were published in 1909 by Edwina E. Abbott cite-ref-11[11]cite-ref-12[12] which was followed up by research into the transfer and retrieval of prior learning.cite-ref-13[13]cite-ref-14[14] In his 1932 book Psychology of Study, C. A. Mace said:
"On the matter of sheer repetitive drill there is another principle of the highest importance: Active repetition is very much more effective than passive repetition. ... there are two ways of introducing further repetitions. We may re-read this list: this is passive repetition. We may recall it to mind without reference to the text before forgetting has begun: this is active repetition. It has been found that when acts of reading and acts of recall alternate, i.e., when every reading is followed by an attempt to recall the items, the efficiency of learning and retention is enormously enhanced." cite-ref-15[15]
Studies in retrieval practice started in 1987 by John. L Richards, who published his findings in a newspaper in New York. Much of the confusion around early studies could have been due to constrained approaches not accounting for context.cite-ref-02-16-0[16] In more recent research with contributions from Hal Pashler, Henry Roediger and many others, testing knowledge can produce better learning,cite-ref-17[17]cite-ref-10-18-0[18]cite-ref-19[19] transfer,cite-ref-6-20-0[20] and retrieval cite-ref-5-21-0[21] results when compared to other forms of study cite-ref-10-18-1[18] that often use recognition cite-ref-22[22] like re-reading cite-ref-23[23] or highlighting.cite-ref-24[24]
Retrieval practice
In recent research, storage strength (how well an item is learned) and retrieval strength (how well an item can be retrieved)cite-ref-7-25-0[25] have become separate measures for retrieval practice.cite-ref-8-26-0[26] Retrieval strength (also known as recall accuracy) is typically higher for restudied words when tested immediately after practice, whereas tested words were higher as time moves on.cite-ref-9-27-0[27] This suggests using tests is more beneficial for long-term memory and retrievalcite-ref-28[28]cite-ref-29[29] which some authors believe is due to limited retrieval success during practicecite-ref-8-26-1[26]cite-ref-9-27-1[27]cite-ref-30[30] supporting the idea that tests are learning opportunities.cite-ref-31[31]
Functional magnetic resonance imaging suggests that retrieval practice strengthens subsequent retention of learning through a "dual action" affecting the anterior and posterior hippocampus regions of the brain.cite-ref-32[32] This could support findings that individual differences in personality traits or with working memory capacity, don't seem to have any negative impacts of the testing effect,cite-ref-33[33] with a greater impact for lower ability individuals.cite-ref-34[34]
Despite some doubting knowledge transfer across a topic when testingcite-ref-35[35] with some studies showing contradictory evidencecite-ref-11-36-0[36] suggesting recognition was better than recall,cite-ref-37[37] inferential thinking has been supportedcite-ref-38[38] and the transfer of learning is at its strongest with application of theory to practice, inference questions, medical education,cite-ref-39[39] and problems involving medical diagnosis.cite-ref-40[40] The transfer can occur across domains,cite-ref-02-16-1[16] paradigms,cite-ref-41[41] and help retention for material not on a final test.cite-ref-42[42] Using retrieval practices also produces less forgetting than studying and restudyingcite-ref-43[43] while helping to identify misconceptions and errorscite-ref-44[44]cite-ref-45[45]cite-ref-46[46] with effects lasting years.cite-ref-47[47]
Repeated testing
Repeated testing have shown statistical significancecite-ref-48[48] and results getting better than repeated studyingcite-ref-12-49-0[49]cite-ref-4-50-0[50] which could be due to testing creating multiple retrieval routes for memory,cite-ref-51[51] allowing individuals to form lasting connections between items,cite-ref-52[52] or blocking information togethercite-ref-82-53-0[53] which can help with memory retentioncite-ref-54[54] and schema recall.cite-ref-55[55] Using spaced repetition has shown an increase on the testing effectcite-ref-56[56]cite-ref-57[57] with a greater impact with a delay in testing,cite-ref-58[58] but the delay could lead to forgettingcite-ref-59[59] or retrieval-induced forgetting.
Delaying the test after a session can have a greater impactcite-ref-14-60-0[60] so studying in the day should be tested in the evening with a delay, but studying in the evening should have an immediate test due the effect sleep has on memory.cite-ref-61[61] Despite divided attention being thought to decrease the testing effect, if it is from a different medium it could enhance the effect.cite-ref-11-36-1[36]
Test difficulty
According to the retrieval effort hypothesis, "difficult but successful retrievals are better for memory than easier successful retrievals" which supports the idea of finding a desirable difficulty within the retrieval practice considering our memory biases.cite-ref-7-25-1[25] Learning a language was better when using unfamiliar words compared to familiar words, supporting higher difficulty resulting in greater learning.cite-ref-13-64-0[64] The difficulty relates to the likelihood of forgettingcite-ref-65[65] as the harder it is to remember, the more likely you are to remember and retain the informationcite-ref-66[66] supporting the notion that more effort is required for longer lasting retentioncite-ref-67[67] similar to the depth of processing at encoding.cite-ref-32-68-0[68] Therefore, lack of effort from students studying could be a factor that reduces its efficiency.cite-ref-12-49-1[49]
Increased difficulty shows decreased initial performance but increased performance on harder tests in the future, so retention and transfer suffer less when training is difficult.cite-ref-82-53-1[53] Even unsuccessful retrieval can enhance learning,cite-ref-69[69] as creating the thought helps with retentioncite-ref-70[70] due to the generation effect.cite-ref-71[71]cite-ref-72[72] Like with processing time, it is the qualitative nature of the information that determines retention.cite-ref-32-68-1[68]
Getting feedback helps with learningcite-ref-73[73] but finding a desirable difficulty for the test combined with feedbackcite-ref-3-74-0[74] is more beneficial than studying or testing without feedback.cite-ref-75[75]cite-ref-76[76] The Read, Recite, Review methodcite-ref-77[77] has been proposed as a method to combine retrieval practice with feedback.cite-ref-78[78]
Test format
The test format doesn't seem to impact the results as it is the process of retrieval that aids the learningcite-ref-0-79-0[79] but transfer-appropriate processing suggests that if the encoding of information is through a format similar to the retrieval format then the test results are likely to be higher, with a mismatch causing lower results.cite-ref-2-80-0[80] However, when short-answer tests or essays are used cite-ref-81[81]cite-ref-82[82] greater gains in results are seen when compared to multiple-choice test cite-ref-83[83]
Cued recall can make retrieval easiercite-ref-84[84] as it reduces the required retrieval strength from an individual which can help short term results,cite-ref-85[85] but can hinder long term retrieval overtime due to reduced retrieval demand during practice.cite-ref-86[86] Quicker learning can reduce the rate of forgetting for a short period of time, but the effect doesn't last as long as more effortful retrieval.cite-ref-87[87] Cueing can be seen when encoding new information overlaps with prior knowledge making retrieval easiercite-ref-88[88]cite-ref-89[89] or from a visual or auditory aid.
Prior knowledge seems to increase the impact of retrieval practice,cite-ref-90[90] but should not be seen as a boundary condition as individuals with higher prior knowledge and individuals with lower prior knowledge both benefit.cite-ref-91[91] Pre-testing can be used to get greater results,cite-ref-92[92]cite-ref-93[93] and the post-testing can be used to facilitate learning and memory of newly studied information, known as the forward testing effect.cite-ref-94[94] Pre-test or practice test accuracy doesn't predict post test results as time affects forgetting cite-ref-62-95-0[95]
Pre-testing effect
The pre-testing effect, also known as errorful generation or pre-questioning, is a related but distinct category where testing material before the material has been learned appears to lead to better subsequent learning performance than would have been the case without the pre-test, provided that feedback is given as to the correct answers once the pre-testing phase is completed or further study is undertaken. Pre-testing has been shown to aid learning in both laboratory. and classroom settings.cite-ref-96[96] In terms of specific examples, pre-testing appears to be a beneficial strategy in language learning,cite-ref-13-64-1[64]cite-ref-82-53-2[53] science classrooms generally,cite-ref-97[97] and specifically with lower ability learners in Chemistry.cite-ref-98[98] Pre-testing also seems to be a good way of introducing a lecture series and reduces mind-wandering during lectures.cite-ref-99[99] However, while some studies show that it does not seem to be as effective as post testing overall,cite-ref-100[100] others show that it is at least as effective as post-testing.cite-ref-101[101] The pre-testing effect does appear to be more target focused on the specific material to be learned and should not be seen as correlated with more generalised curiosity.cite-ref-102[102] While the strategy has been demonstrated to have learning benefits across different age groups and subject matters, it also appears to be more suited for more concrete material such as learning facts and concepts. It can be used with a variety of materials, including reading passages, videos, and live lectures.cite-ref-103[103]
Practice methods
When compared to concept mapping alone, retrieval practice is more beneficial,cite-ref-104[104] despite students not seeing retrieval practice as a useful learning tool.cite-ref-105[105] When combined, learner performance was increased, suggesting concept mapping is a tool that should be combined with retrieval practicecite-ref-106[106] alongside other non-verbal responses.cite-ref-107[107] Retrieval helps with mental organizationcite-ref-108[108] which can work well with concept mapping. Multimedia testing can be usedcite-ref-109[109] alongside flashcards as a method of retrieval practice but removing cards too early can result in lower long term retention.cite-ref-110[110] Individuals may not correctly interpret the outcome of practice cardscite-ref-111[111] contributing to dropped cards which impact future retrieval attempts cite-ref-72-112-0[112] therefore resulting in lower results due to increased forgetting.cite-ref-14-60-2[60]
It is advised that students,cite-ref-16-113-0[113] people in care unitscite-ref-114[114] and teaching professionalscite-ref-115[115]cite-ref-116[116]cite-ref-117[117]cite-ref-17-118-0[118] use distributedcite-ref-119[119] retrieval practicecite-ref-120[120] with feedback to aid their studies.cite-ref-121[121] Interleaved practice, self-explanation,cite-ref-15-2-1[2] and elaborative interrogationcite-ref-16-113-1[113] can be useful but need more research.cite-ref-122[122] Summarization can be useful for individuals trained how to use to get the most from it.cite-ref-123[123] Keyword mnemonics and imagery for text have been somewhat helpful but the effects are often short lived.cite-ref-42-124-0[124]cite-ref-16-113-2[113] However, if each of these methods are integrated with retrieval elements the testing effect is more likely to occur.
Test benefits
A list of benefits of retrieval practice.cite-ref-92-125-0[125]
• Aids later retention
• Identifies knowledge gaps
• Aids future related learning
• Prevents interference from prior material in future learning
• Aids transfer of knowledge to new contexts
• Aids knowledge organization
• Aids retrieval of untested information
• Improves metacognitive monitoring
• Provides feedback to instructors
• Frequent testing encourages study intentions
Quizzes
A meta-analysis found the following links between frequent low-stakes quizzes in real classes and improved student academic performance:cite-ref-126[126]
• There was an association between the use of quizzes and academic performance.
• This association was stronger in psychology classes
• This association was stronger in all classes when quiz performance could improve class grades.
• Students doing well on quizzes tended to lead to students doing well on final exams
• Regular quizzing increased the chances of students passing classes
Transfer of learning
Learning using retrieval practice appears to be one of the most effective methods for promoting transfer of learning. In particular the following three techniques have been identified as particularly beneficial for transfer especially when combined with feedback: i) Implementing broad rather than narrow retrieval exercises ii) Encouraging meaningful explanations of concepts or topics iii) Using a variety of complexity and formats with questions such as retrieval questions that require inference.cite-ref-127[127]
Considerations
Complex materials
Some researchers have applied aspects of cognitive load theory to suggest the testing effect may disappear with increasing task difficulty due to increased element interactivity.cite-ref-128[128] This has been addressed in the literature with studies that show complex learning is benefitted by retrieval practice.cite-ref-129[129] Further research has demonstrated that higher-order retrieval does not need to be based on a lower-level factual recall, and that from the beginning of the learning period, both should be combined for best effect.cite-ref-130[130]
Future research
Further reading
• RetrievalPractice.org
• Learning Scientists
• American Educator
• Powerful Teaching: Unleash the Science of Learning by Pooja K. Agarwal and Patrice M. Bain
• Barbara Oakley. Online course Learning How to Learn on coursera
• Brown, P.C., 2014. Make it stick. Harvard University Press.
• Forget what you know about good study habits in the New York Times
• Students Should Be Tested More, Not Less in the Atlantic
• Comprehensive Guide to Applying Active Recall Techniques by Productive Fish
References
cite-note-11. ↑ citerefroedigerbutler2011Roediger, H. L.; Butler, A. C. (2011). "The critical role of retrieval practice in long-term retention" (PDF). Trends in Cognitive Sciences. 15 (1): 20–27. doi:10.1016/j.tics.2010.09.003. hdl:10818/24277. PMID 20951630. S2CID 11014168. Archived from the original (PDF) on 2017-12-15. Retrieved 2015-08-19.
cite-note-15-22. ↑ citerefdunloskyrawsonmarshnathan2013Dunlosky, J.; Rawson, K. A.; Marsh, E. J.; Nathan, M. J.; Willingham, D. T. (2013). "Improving students' learning with effective learning techniques: Promising directions from cognitive and educational psychology". Psychological Science in the Public Interest. 14 (1): 4–58. doi:10.1177/1529100612453266. PMID 26173288. S2CID 220053697.
cite-note-33. ↑ "Remember!". Retrieval Practice: A Powerful Strategy to Improve Learning. Retrieved 2016-03-12.
cite-note-55. ↑ "Practice effect". APA Dictionary of Psychology. Washington, DC: American Psychological Association. n.d. Retrieved 2021-12-04.
cite-note-66. ↑ citerefbaetherriaultredifer2018Bae, Christine L.; Therriault, David J.; Redifer, Jenni L. (2018). "Investigating the testing effect: Retrieval as a characteristic of effective study strategies". Learning and Instruction. 60: 206–214. doi:10.1016/j.learninstruc.2017.12.008. ISSN 0959-4752. S2CID 149067724.
cite-note-77. ↑ "The Testing Effect". Revunote. 9 December 2014. Archived from the original on August 7, 2012.
cite-note-99. ↑ citereflocke1690Locke, John (1690). An Essay Concerning Humane Understanding. Project Gutenberg.
cite-note-1010. ↑ citerefjames1890James, William (1890). The Principles of Psychology Vol 1. New York: Holt. pp. Chapter 16 pg 686.
cite-note-1313. ↑ "Experiments as the relative efficiency of men and women in memory & reasoning". psycnet.apa.org. Retrieved 2021-12-06.
cite-note-1515. ↑ citerefmace1932Mace, C. A. (1932). The Psychology of Study. New York: R.M. McBride & Co. p. 39.
cite-note-5-2121. ↑ citerefroedigerkarpicke2006Roediger, Henry L.; Karpicke, Jeffrey D. (September 2006). "The Power of Testing Memory: Basic Research and Implications for Educational Practice". Perspectives on Psychological Science. 1 (3): 181–210. doi:10.1111/j.1745-6916.2006.00012.x. ISSN 1745-6916. PMID 26151629. S2CID 2184171.
cite-note-2323. ↑ citerefkarpickebutlerroediger2009Karpicke, Jeffrey D.; Butler, Andrew C.; Roediger, Henry L. (2009). "Metacognitive strategies in student learning: do students practise retrieval when they study on their own?". Memory (Hove, England). 17 (4): 471–479. doi:10.1080/09658210802647009. ISSN 1464-0686. PMID 19358016. S2CID 36234279.
cite-note-7-2525. ↑ Bjork, Robert A., and Elizabeth L. Bjork. "A new theory of disuse and an old theory of stimulus fluctuation." _From learning processes to cognitive processes: Essays in honor of William K. Estes_ 2 (1992): 35-67.
cite-note-9-2727. ↑ citerefvan-den-broeksegerstakashimaverhoeven2014van den Broek, Gesa S. E.; Segers, Eliane; Takashima, Atsuko; Verhoeven, Ludo (2014-10-03). "Do testing effects change over time? Insights from immediate and delayed retrieval speed". Memory. 22 (7): 803–812. doi:10.1080/09658211.2013.831455. hdl:2066/129864. ISSN 0965-8211. PMID 23998337. S2CID 23919228.
cite-note-2828. ↑ citerefroedigerkarpicke2006Roediger, H. L.; Karpicke, J. D. (2006). "Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention" (PDF). Psychological Science. 17 (3): 249–255. doi:10.1111/j.1467-9280.2006.01693.x. PMID 16507066. S2CID 16067307. Archived from the original (PDF) on 13 May 2015. Retrieved 17 August 2015.
cite-note-3030. ↑ citerefhalamishbjork2011Halamish, Vered; Bjork, Robert A. (2011). "When does testing enhance retention? A distribution-based interpretation of retrieval as a memory modifier". Journal of Experimental Psychology: Learning, Memory, and Cognition. 37 (4): 801–812. CiteSeerX 10.1.1.1033.8690. doi:10.1037/a0023219. PMID 21480751.
cite-note-3232. ↑ citerefwiklund-h-rnqviststillesj-anderssonjonsson2021Wiklund-Hörnqvist, Carola; Stillesjö, Sara; Andersson, Micael; Jonsson, Bert; Nyberg, Lars (January 2021). "Retrieval practice facilitates learning by strengthening processing in both the anterior and posterior hippocampus". Brain and Behavior. 11 (1): e01909. doi:10.1002/brb3.1909. ISSN 2162-3279. PMC 7821628. PMID 33094555.
cite-note-3333. ↑ citerefbertilssonstenlundwiklund-h-rnqvistjonsson2021Bertilsson, Frida; Stenlund, Tova; Wiklund-Hörnqvist, Carola; Jonsson, Bert (March 2021). "Retrieval Practice: Beneficial for All Students or Moderated by Individual Differences?". Psychology Learning & Teaching. 20 (1): 21–39. doi:10.1177/1475725720973494. ISSN 1475-7257. S2CID 229459300.
cite-note-3434. ↑ citerefagarwalfinleyroseroediger2017Agarwal, Pooja K.; Finley, Jason R.; Rose, Nathan S.; Roediger, Henry L. (2017-07-03). "Benefits from retrieval practice are greater for students with lower working memory capacity". Memory. 25 (6): 764–771. doi:10.1080/09658211.2016.1220579. ISSN 0965-8211. PMID 27531308. S2CID 3649863.
cite-note-3939. ↑ citerefdobson2013Dobson, John L. (June 2013). "Retrieval practice is an efficient method of enhancing the retention of anatomy and physiology information". Advances in Physiology Education. 37 (2): 184–191. doi:10.1152/advan.00174.2012. ISSN 1043-4046. PMID 23728136. S2CID 16807647.
cite-note-4141. ↑ citerefneedhambegg1991Needham, D. R.; Begg, I. M. (1991). "Problem-oriented training promotes spontaneous analogical transfer: memory-oriented training promotes memory for training". Memory & Cognition. 19 (6): 543–557. doi:10.3758/bf03197150. ISSN 0090-502X. PMID 1758301. S2CID 24200377.
cite-note-4242. ↑ citerefchanmcdermottroediger2006Chan, Jason C. K.; McDermott, Kathleen B.; Roediger, Henry L. (2006). "Retrieval-induced facilitation: initially nontested material can benefit from prior testing of related material". Journal of Experimental Psychology. General. 135 (4): 553–571. doi:10.1037/0096-3445.135.4.553. ISSN 0096-3445. PMID 17087573.
cite-note-4646. ↑ citerefbangert-drownskulikkulikmorgan1991Bangert-Drowns, Robert L.; Kulik, Chen-Lin C.; Kulik, James A.; Morgan, MaryTeresa (1991-06-01). "The Instructional Effect of Feedback in Test-Like Events". Review of Educational Research. 61 (2): 213–238. doi:10.3102/00346543061002213. ISSN 0034-6543. S2CID 146582125.
cite-note-4747. ↑ "Test-enhanced learning in the classroom: Long-term improvements from quizzing". psycnet.apa.org. Retrieved 2021-12-07.
cite-note-4-5050. ↑ citerefroedigerkarpicke2006Roediger, H. L.; Karpicke, J. D. (2006). "Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention" (PDF). Psychological Science. 17 (3): 249–255. doi:10.1111/j.1467-9280.2006.01693.x. PMID 16507066. S2CID 16067307. Archived from the original (PDF) on 13 May 2015. Retrieved 17 August 2015.
cite-note-82-5353. ↑ citerefschneiderhealybourne2002Schneider, Vivian I.; Healy, Alice F.; Bourne, Lyle E. (2002-02-01). "What Is Learned under Difficult Conditions Is Hard to Forget: Contextual Interference Effects in Foreign Vocabulary Acquisition, Retention, and Transfer". Journal of Memory and Language. 46 (2): 419–440. doi:10.1006/jmla.2001.2813. ISSN 0749-596X.
cite-note-6262. ↑ "Normal forgetting of verbal lists as a function of their degree of learning". content.apa.org. Retrieved 2021-12-06.
cite-note-6666. ↑ citerefpycrawson2009Pyc, Mary A.; Rawson, Katherine A. (May 2009). "Testing the retrieval effort hypothesis: Does greater difficulty correctly recalling information lead to higher levels of memory?" (PDF). Journal of Memory and Language. 60 (4): 437–447. doi:10.1016/j.jml.2009.01.004. S2CID 73651886. Archived from the original (PDF) on 2015-05-18. Retrieved 2015-05-15.
cite-note-6969. ↑ citerefkornellhaysbjork2009Kornell, Nate; Hays, Matthew Jensen; Bjork, Robert A. (2009). "Unsuccessful retrieval attempts enhance subsequent learning". Journal of Experimental Psychology: Learning, Memory, and Cognition. 35 (4): 989–998. doi:10.1037/a0015729. ISSN 0278-7393. PMID 19586265.
cite-note-7171. ↑ citerefrosnerelmanshimamura2013Rosner, Zachary A.; Elman, Jeremy A.; Shimamura, Arthur P. (2013). "The generation effect: activating broad neural circuits during memory encoding". Cortex; A Journal Devoted to the Study of the Nervous System and Behavior. 49 (7): 1901–1909. doi:10.1016/j.cortex.2012.09.009. ISSN 1973-8102. PMC 3556209. PMID 23079490.
cite-note-3-7474. ↑ citerefkubikgaschlerhausman2021Kubik, Veit; Gaschler, Robert; Hausman, Hannah (March 2021). "PLAT 20(1) 2021: Enhancing Student Learning in Research and Educational Practice: The Power of Retrieval Practice and Feedback". Psychology Learning & Teaching. 20 (1): 1–20. doi:10.1177/1475725720976462. ISSN 1475-7257. S2CID 232170985.
cite-note-7676. ↑ citereflarsenbutlerroediger2009Larsen, Douglas P.; Butler, Andrew C.; Roediger, Henry L. (2009). "Repeated testing improves long-term retention relative to repeated study: a randomised controlled trial". Medical Education. 43 (12): 1174–1181. doi:10.1111/j.1365-2923.2009.03518.x. ISSN 1365-2923. PMID 19930508. S2CID 2446794.
cite-note-7878. ↑ citerefmcdanielhowardeinstein2009McDaniel, Mark A.; Howard, Daniel C.; Einstein, Gilles O. (2009). "The read-recite-review study strategy: effective and portable". Psychological Science. 20 (4): 516–522. doi:10.1111/j.1467-9280.2009.02325.x. ISSN 1467-9280. PMID 19320858. S2CID 8841135.
cite-note-0-7979. ↑ citerefyangpottsshanks2018Yang, Chunliang; Potts, Rosalind; Shanks, David R. (2018-04-11). "Enhancing learning and retrieval of new information: a review of the forward testing effect". npj Science of Learning. 3 (1): 8. Bibcode:2018npjSL...3....8Y. doi:10.1038/s41539-018-0024-y. ISSN 2056-7936. PMC 6220253. PMID 30631469.
cite-note-2-8080. ↑ citerefyangluovadilloyu2021Yang, Chunliang; Luo, Liang; Vadillo, Miguel A.; Yu, Rongjun; Shanks, David R. (April 2021). "Testing (quizzing) boosts classroom learning: A systematic and meta-analytic review". Psychological Bulletin. 147 (4): 399–435. doi:10.1037/bul0000309. ISSN 1939-1455. PMID 33683913. S2CID 232158956.
cite-note-8181. ↑ citerefroedigeragarwalmcdanielmcdermott2011Roediger, Henry L.; Agarwal, Pooja K.; McDaniel, Mark A.; McDermott, Kathleen B. (2011). "Test-enhanced learning in the classroom: Long-term improvements from quizzing". Journal of Experimental Psychology: Applied. 17 (4): 382–395. doi:10.1037/a0026252. ISSN 1939-2192. PMID 22082095.
cite-note-8282. ↑ citerefmcdanielandersonderbishmorrisette2007McDaniel, Mark A.; Anderson, Janis L.; Derbish, Mary H.; Morrisette, Nova (2007-07-01). "Testing the testing effect in the classroom". European Journal of Cognitive Psychology. 19 (4–5): 494–513. doi:10.1080/09541440701326154. ISSN 0954-1446. S2CID 102343760.
cite-note-8383. ↑ citerefagarwalbainchamberlain2012Agarwal, Pooja K.; Bain, Patrice M.; Chamberlain, Roger W. (2012-09-01). "The Value of Applied Research: Retrieval Practice Improves Classroom Learning and Recommendations from a Teacher, a Principal, and a Scientist". Educational Psychology Review. 24 (3): 437–448. doi:10.1007/s10648-012-9210-2. ISSN 1573-336X. S2CID 143750450.
cite-note-8585. ↑ citerefcarpenterdelosh2006Carpenter, Shana K.; DeLosh, Edward L. (2006). "Impoverished cue support enhances subsequent retention: support for the elaborative retrieval explanation of the testing effect". Memory & Cognition. 34 (2): 268–276. doi:10.3758/bf03193405. ISSN 0090-502X. PMID 16752591. S2CID 41086978.
cite-note-8787. ↑ "The psychology of human learning". psycnet.apa.org. Retrieved 2021-12-06.
cite-note-8888. ↑ citerefmorrisbransfordfranks1977Morris, C. Donald; Bransford, John D.; Franks, Jeffery J. (1977-10-01). "Levels of processing versus transfer appropriate processing". Journal of Verbal Learning and Verbal Behavior. 16 (5): 519–533. doi:10.1016/S0022-5371(77)80016-9. ISSN 0022-5371.
cite-note-8989. ↑ citereftulving1983Tulving, Endel (1983). Elements of Episodic Memory. Oxford University Press.
cite-note-9090. ↑ citerefgieblmenastormbjork2021Giebl, Saskia; Mena, Stefany; Storm, Benjamin C.; Bjork, Elizabeth Ligon; Bjork, Robert A. (2021-03-01). "Answer First or Google First? Using the Internet in ways that Enhance, not Impair, One's Subsequent Retention of Needed Information". Psychology Learning & Teaching. 20 (1): 58–75. doi:10.1177/1475725720961593. ISSN 1475-7257. S2CID 226317994.
cite-note-9393. ↑ citerefpansana2021Pan, Steven C.; Sana, Faria (2021-04-01). "Pretesting versus posttesting: Comparing the pedagogical benefits of errorful generation and retrieval practice". Journal of Experimental Psychology: Applied. 27 (2): 237–257. doi:10.1037/xap0000345. ISSN 1939-2192. PMID 33793291. S2CID 232762494.
cite-note-62-9595. ↑ citerefdunloskyrawsonmcdonald2002Dunlosky, John; Rawson, Katherine A.; McDonald, Susan L. (2002), Schwartz, Bennett L.; Perfect, Timothy J. (eds.), "Influence of practice tests on the accuracy of predicting memory performance for paired associates, sentences, and text material", Applied Metacognition, Cambridge: Cambridge University Press, pp. 68–92, ISBN 978-0-521-00037-6, retrieved 2021-12-06
cite-note-9696. ↑ citerefcarpenterrahmanperkins2018Carpenter, Shana K.; Rahman, Shuhebur; Perkins, Kyle (March 2018). "The effects of prequestions on classroom learning". Journal of Experimental Psychology: Applied. 24 (1): 34–42. doi:10.1037/xap0000145. ISSN 1939-2192. PMID 29595303. S2CID 4465862.
cite-note-9797. ↑ citerefrichlandkornellkao2009Richland, Lindsey E.; Kornell, Nate; Kao, Liche Sean (2009). "The pretesting effect: Do unsuccessful retrieval attempts enhance learning?". Journal of Experimental Psychology: Applied. 15 (3): 243–257. doi:10.1037/a0016496. ISSN 1939-2192. PMID 19751074.
cite-note-9898. ↑ citerefpyburnpazicnibenassitappin2014Pyburn, Daniel T.; Pazicni, Samuel; Benassi, Victor A.; Tappin, Elizabeth M. (2014-12-09). "The Testing Effect: An Intervention on Behalf of Low-Skilled Comprehenders in General Chemistry". Journal of Chemical Education. 91 (12): 2045–2057. Bibcode:2014JChEd..91.2045P. doi:10.1021/ed4009045. ISSN 0021-9584.
cite-note-9999. ↑ citerefpanschmittbjorksana2020Pan, Steven C.; Schmitt, Alexandra G.; Bjork, Elizabeth Ligon; Sana, Faria (December 2020). "Pretesting reduces mind wandering and enhances learning during online lectures". Journal of Applied Research in Memory and Cognition. 9 (4): 542–554. doi:10.1016/j.jarmac.2020.07.004. ISSN 2211-369X. S2CID 221093237.
cite-note-100100. ↑ citereflatimierriegertpeyrely2019Latimier, Alice; Riegert, Arnaud; Peyre, Hugo; Ly, Son Thierry; Casati, Roberto; Ramus, Franck (2019-09-24). "Does pre-testing promote better retention than post-testing?". npj Science of Learning. 4 (1): 15. Bibcode:2019npjSL...4...15L. doi:10.1038/s41539-019-0053-1. ISSN 2056-7936. PMC 6760123. PMID 31583117.
cite-note-101101. ↑ citerefpansana2021Pan, Steven C.; Sana, Faria (June 2021). "Pretesting versus posttesting: Comparing the pedagogical benefits of errorful generation and retrieval practice". Journal of Experimental Psychology: Applied. 27 (2): 237–257. doi:10.1037/xap0000345. ISSN 1939-2192. PMID 33793291. S2CID 232762494.
cite-note-102102. ↑ citerefhollinsseabrookeinksterwills2023Hollins, Timothy J.; Seabrooke, Tina; Inkster, Angus; Wills, Andy; Mitchell, Chris J. (2023-02-07). "Pre-testing effects are target-specific and are not driven by a generalised state of curiosity". Memory. 31 (2): 282–296. doi:10.1080/09658211.2022.2153141. hdl:10026.1/20003. ISSN 0965-8211. PMID 36475537. S2CID 254432248.
cite-note-103103. ↑ citerefpancarpenter2023Pan, Steven; Carpenter, Shana (2023). "Prequestioning and Pretesting Effects: A Review of Empirical Research, Theoretical Perspectives, and Applications". psyarxiv.com. Retrieved 2023-08-20.
cite-note-104104. ↑ "A powerful way to improve learning and memory". www.apa.org. Retrieved 2021-12-06.
cite-note-105105. ↑ citereflechugaortega-tudelag-mez-ariza2015Lechuga, M. Teresa; Ortega-Tudela, Juana M.; Gómez-Ariza, Carlos J. (December 2015). "Further evidence that concept mapping is not better than repeated retrieval as a tool for learning from texts". Learning and Instruction. 40: 61–68. doi:10.1016/j.learninstruc.2015.08.002.
cite-note-108108. ↑ "Subjective organization in free recall of "unrelated" words". psycnet.apa.org. Retrieved 2021-12-07.
cite-note-111111. ↑ "How do we know that we know? The accessibility model of the feeling of knowing". psycnet.apa.org. Retrieved 2021-12-06.
cite-note-114114. ↑ citerefcooperverbeckmccallisterspitzer2020Cooper, Avraham Z.; Verbeck, Nicole; McCallister, Jennifer W.; Spitzer, Carleen R. (2020-12-01). "Incorporating Retrieval Practice Into Intensive Care Unit Teaching Rounds: A Feasibility Study". Journal of Graduate Medical Education. 12 (6): 778–781. doi:10.4300/JGME-D-20-00082.1. ISSN 1949-8357. PMC 7771589. PMID 33391605.
cite-note-115115. ↑ citerefmcdanielagarwalhuelsermcdermott2011McDaniel, Mark A.; Agarwal, Pooja K.; Huelser, Barbie J.; McDermott, Kathleen B.; Roediger, Henry L. (2011). "Test-enhanced learning in a middle school science classroom: The effects of quiz frequency and placement". Journal of Educational Psychology. 103 (2): 399–414. doi:10.1037/a0021782. ISSN 1939-2176.
cite-note-17-118118. ↑ citerefagarwalnunesblunt2021Agarwal, Pooja K.; Nunes, Ludmila D.; Blunt, Janell R. (2021-03-14). "Retrieval Practice Consistently Benefits Student Learning: a Systematic Review of Applied Research in Schools and Classrooms". Educational Psychology Review. 33 (4): 1409–1453. doi:10.1007/s10648-021-09595-9. ISSN 1040-726X. S2CID 235079733.
cite-note-120120. ↑ Gurung, R.A., 2005. How do students really study (and does it matter). Education, 39, pp.323-340.
cite-note-122122. ↑ citerefendowment-foundationEndowment Foundation, Education. "Cognitive Science Approaches in the Classroom" (PDF). Education Endowment Foundation Website: 15–48 – via Education Endowment Foundation.
cite-note-92-125125. ↑ citerefroediger-iiiputnamsmith2011Roediger III, Henry L.; Putnam, Adam L.; Smith, Megan A. (2011-01-01), Mestre, Jose P.; Ross, Brian H. (eds.), "Chapter One - Ten Benefits of Testing and Their Applications to Educational Practice", Psychology of Learning and Motivation, vol. 55, Academic Press, pp. 1–36, doi:10.1016/B978-0-12-387691-1.00001-6, retrieved 2021-12-07
cite-note-126126. ↑ citerefsotolacrede2021Sotola, Lukas K.; Crede, Marcus (June 2021). "Regarding Class Quizzes: a Meta-analytic Synthesis of Studies on the Relationship Between Frequent Low-Stakes Testing and Class Performance". Educational Psychology Review. 33 (2): 407–426. doi:10.1007/s10648-020-09563-9. ISSN 1040-726X. S2CID 225447986.
cite-note-127127. ↑ citerefpanagarwalPan, Steven; Agarwal, Pooja. "Retrieval Practice And Transfer Of Learning Fostering Students' Application Of Knowledge" (PDF). Retrieval Practice Org: 5 – via UC San Diego.
cite-note-128128. ↑ citerefvan-gogsweller2015van Gog, Tamara; Sweller, John (2015-06-01). "Not New, but Nearly Forgotten: the Testing Effect Decreases or even Disappears as the Complexity of Learning Materials Increases". Educational Psychology Review. 27 (2): 247–264. doi:10.1007/s10648-015-9310-x. hdl:1765/92178. ISSN 1573-336X. S2CID 145345472.